Structure-Aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation

نویسندگان

چکیده

Morphable models are essential for the statistical modeling of 3D faces. Previous works on morphable mostly focus large-scale facial geometry but ignore details. This paper augments in representing details by learning a Structure-aware Editable Model (SEMM). SEMM introduces detail structure representation based distance field wrinkle lines, jointly modeled with displacements to establish better correspondences and enable intuitive manipulation structure. Besides, two transformation modules translate expression blendshape weights age values into changes latent space, allowing effective semantic editing while maintaining identity. Extensive experiments demonstrate that proposed model compactly represents details, outperforms previous methods animation qualitatively quantitatively, achieves line Code available at https://github.com/gerwang/facial-detail-manipulation .

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Resolution-Aware 3D Morphable Model

Face reconstruction models can be classified into two groups: the 2D face models and the 3D face models. The 2D-based group includes Active Appearance Models (AAMs) [4], which achieved great success. But the problem for AAMS is that the reconstruction with AAMs fails if the indepth rotation of the face becomes large. 3D-based methods have been proposed to solve the problem. 3D morphable model (...

متن کامل

Occlusion-aware 3D Morphable Face Models

We propose a probabilistic occlusion-aware 3D Morphable Face Model adaptation framework for face image analysis based on the Analysis-by-Synthesis setup. In natural images, parts of the face are often occluded by a variety of objects. Such occlusions are a challenge for face model adaptation. We propose to segment the image into face and non-face regions and model them separately. The segmentat...

متن کامل

3D Videorealistic Facial Animation

Approach: In this work, we plan instead to explore the use of structured light techniques for acquiring 3D. These techniques [4] acquire 3D shape by projecting a grid on a subject’s face. By analyzing the deformations of these lines, the 3D shape is inferred. The advantage of using structured light is that it enables frame-rate capture of 3D (unlike Cyberware), and acquires more accurate 3D tha...

متن کامل

A Morphable Part Model for Shape Manipulation

We introduce morphable part models for smart shape manipulation using an assembly of deformable parts with appropriate boundary conditions. In an analysis phase, we characterize the continuous allowable variations both for the individual parts and their interconnections using Gaussian shape models with low rank covariance. The discrete aspect of how parts can be assembled is captured using a sh...

متن کامل

3D Morphable Model Parameter Estimation

Estimating the structure of the human face is a long studied and difficult task. In this paper we present a new method for estimating facial structure from only a minimal number of salient feature points across a video sequence. The presented method uses both an Extended Kalman Filter (EKF) and a Kalman Filter (KF) to regress 3D Morphable Model (3DMM) shape parameters and solve 3D pose using a ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2022

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-20062-5_15